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SPECIFICATION 

TO ALL WHOM IT MAY CONCERN: 

BE IT KNOWN that we, Takayuki Sugahara, Masayoshi 
Nishitani and Kenjiro Ueda, residents and citizens of 
Japan, have invented certain new and useful improvements 
in a 



RECORDING AND REPRODUCTION APPARATUS, RECORDING AND 
REPRODUCTION METHOD, RECORDING AND REPRODUCTION PROGRAM 
FOR IMPERCEPTIBLE INFORMATION TO BE EMBEDDED IN 

DIGITAL IMAGE DATA 



of which the following is a specification. 



i" 

1 

RECORDING AND REPRODUCTION APPARATUS , RECORDING AND REPRODUCTION 
METHOD, RECORDING AND REPRODUCTION PROGRAM FOR IMPERCEPTIBLE 
INFORMATION TO BE EMBEDDED IN DIGITAL IMAGE DATA 

5 BACKGROUND OF THE INVENTION 

The present invention relates to a recording and a 
reproduction apparatus, a recording and a reproduction method, 
and a recording and a reproduction program for information to 
be embedded in digital image data. Particularly, this invention 

10 relates to a recording and a reproduction apparatus, a recording 
and a reproduction method, and a recording and a reproduction 
program for imperceptible information to be embedded into digital 
image data by, for example, electronic watermarking, the embedded 
information being used for determining whether digital image data 

15 has been tampered with, especially, in determination of copyright 
violation when the embedded information is used as copyright 
information. 

With distribution of digital content, images, music, etc. , 
over a communication network, such as, the Internet, becoming 
20 popular, several types of technique of embedding an encoded 
electronic watermarking signal in a digital signal of the content 
have been proposed for protection of the content against illegal 
duplication or tampering. 

For example, the following three literatures disclose 
25 electronic watermarking. 

(1) Japanese Unexamined Patent Publication No. 2000-287065 

(2) Non-patent literature X \A Copyright Information 
Embeddi ng Method using DCT (Discrete Cosine Transform) for Digital 
Movies", SCIS'97-31G, The 1997 Symposium on Cryptography and 

30 Information Security, Fukuoka, Japan, January 2 9-February 1 , 1997, 
The Institute of Electronics, Information and Communication 
Engineers 

(3) Non-patent literature X \A Watermarking Scheme to Image 
Data by FN Sequence", SCIS'97-26B, The 1997 Symposium on 

35 Cryptography and Information Security, Fukuoka, Japan, January 
29-February 1, 1997, The Institute of Electronics, Information 
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and Communi cation Engineers 

In detail, the Japanese Unexamined Patent Publication (1) 
discloses an image processing system equipped with an image 
processing unit and an image display device. 
5 The image processing unit provides an original picture 

resulting from embedding electronic watermark information that 
can be extractedby using a watermark key , including authentication 
information which authenticates an image file from a legal server 
into an original image and provides the watermark key. 

10 The image display device uses the watermark key served by 

the image processing unit, extracts the electronic watermark 
information from the original image, stores the original image 
whose falsification is discriminated by using the watermark key 
and the watermark key itself, extracts the electronic watermark 

15 information from the served original image by using the watermark 
key served the by an image management server properly serving 
the original image and the watermark key to a utility destination, 
and displays the original image whose falsification is 
discriminated by using the authentication information of the 

20 watermark key for a purpose of browsing. 

The non-patent literature (2) discloses a new watermarking 
method which is suitable for MPEG bit stream. The method based 
on modifying DCT coefficients are better than the method based 
on modifying the other domain such as motion vectors or quantizer 

25 matrices against erasing copyright information attack using 
editing or compression. 

The non -patent literature (3) discloses adatahidingmethod 
which uses a PN sequence in the spread spectrum technique . Anarrow 
band signal to stand for a signature is set to a wideband channel 

30 of which an image is spread. When converting the spread spectrum 
to the normal image by PN sequence, inversely, the signature is 
embedded in wideband channel, which is low in power. Thus, the 
signature does not give serious damage to the image. 

According to the electronic watermarking information 

35 embedding techniques described above, electronic watermarking 
information is recorded through a specific recording or encoding 
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processing so that visual inspection of" conversion of image data 
is almost impossible. The recorded electronic watermarking 
information is extracted through processing which is the inverse 
of the recording or encoding processing. It is thus determined 
5 whether the image data has been tampered with by checking the 
extracted electronic watermarking information, irrespective of" 
the type of" image-data delivery mechanism (via computers network 
or storage medium) . 

Nevertheless in these electronic watermarking information 

10 embedding techniques, electronic watermarking information is 
usually selectively embedded into some local areas of one frame 
image not in the entire frame image. 

This leads to a trouble in that the electronic watermarking 
information remains unchanged when image data recorded in areas 

15 with no watermarking information embedded has been tampered with, 
thus tampering being undetected. 

Moreover, a uniform code information is used as electronic 
watermarking information and embedded into image data as it is 
or after encoded by a certain algorism. Such uniform code 

20 information is easily extracted once the embedding technique is 
detected. The embedded content is thus at a high risk of being 
detected even if it has been encoded. 

SUMMARY OF THE INVENTION 
25 Apurpose of the present invention is to provided a recording 

apparatus , a recording method and a recording program for embedding 
imperceptible information into digital image data and also a 
reproduction apparatus , a reproduction method and a reproduction 
program for easily and accurately determining whether image data 
30 has been tampered with in any fields of one frame image. 

The present invention provides an apparatus for embedding 
imperceptible codes into digital image data comprising: a data 
divider to divide, per frame, digital image data into an "N" number 
of fields ("N" being an integer of 2 or more) ; a code producer 
35 to produce an N/m number of combinations of imperceptible codes , 
each combination having an X W number of imperceptible codes given 
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by a function, an inverse of a specific function that gives a 
specific identification code by using the xx m" number of 
imperceptible codes as variables ("m" being an integer of 2 or 
more and given by dividing "N" by an integer) ; and a code embeder 
5 to embed the N/m number of combinations of imperceptible codes 
into image data divided into the "N" number of fields so that 
the "m" number of imperceptible codes of each combination are 
embedded into image data in the "m" number of fields according 
to a specific rule of positional correspondence to give correlation 
10 among the X W number of fields in the "N" number of fields of 
one frame. 

Moreover, the present invention provides an apparatus for 
extracting imperceptible codes from digital image data comprising : 
a data divider to divide, per frame, input digital image data 

15 into an U N" number of fields ("N" being an integer of 2 or more) 
according to a specific rule of positional correspondence to give 
correlation among an V number of fields in the "N" number of 
fields of one frame ("m" being an integer of 2 or more and given 
bydividing^N" by an integer) , the input digital image data carrying 

20 imperceptible codes that have been embedded into the input digital 
image data by dividing, per frame, original digital image data 
into the "N" number of fields, producing an N/m number of 
combinations of imperceptible codes , each combination having the 
"m" number of imperceptible codes given by a function, an inverse 

25 of a specific function that gives a specific identification code 
by using the X W number of imperceptible codes as variables, and 
embedding the N/m number of combinations of imperceptible codes 
into image data divided into the U N" number of fields according 
to a specific code embedding technique so that the w m" number 

30 of imperceptible codes of each combination are embedded into image 
data in the "m" number of fields according to the rule of positional 
correspondence; a code extractor to extract the imperceptible 
codes embedded into the image data divided into the "N" number 
of fields according to a code extraction technique corresponding 

35 to the code embedding technique; a code-pair combiner to combine 
the extracted imperceptible codes into the N/m number of 
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combinations according to the rule of positional correspondence; 
a code operator to execute the specific function to conduct a 
specific operation by using the imperceptible codes of each of 
the N/m number of combinations as variables; and a determiner 
5 to determine that the input digital image data has not been tampered 
with only when results of the specif ic operation is equal to specific 
identification code for all of the N/m number of combinations. 

Furthermore, the present invention provides a method of 
CTibedding imperceptible codes into digital image data comprising 

10 the steps of: dividing, per frame, digital image data into an 
"N" number of fields ("N" being an integer of 2 or more) ; producing 
an N/m number of combinations of imperceptible codes, each 
combination having an W number of imperceptible codes given 
by a function, an inverse of a specific function that gives a 

15 specific identification code by using the "m" number of 
imperceptible codes as variables ("m" being an integer of 2 or 
more and given by dividing n N" by an integer) ; and embedding the 
N/m number of combinations of imperceptible codes into image data 
divided into the "N" number of fields so that the M m" number of 

20 imperceptible codes of each combination are embedded into image 
data in the W number of fields according to a specific rule 
of positional correspondence to give correlation among the X W 
number of fields in the "N" number of fields of one frame. 

Furthermore , the present invention provides a method of 

25 extracting imperceptible codes from digital image data comprising 
the steps of: dividing, per frame, input digital image data into 
an "N" number of fields ("W being an integer of 2 or more) according 
to a specific rule of positional correspondence to give correlation 
among an V number of fields in the "N" number of fields of one 

30 frame ("m" being an integer of 2 or more and given by dividing 
W N" by an integer) , the input digital image data carrying 
imperceptible codes that have been embedded into the input digital 
image data by dividing, per frame, original digital image data 
into the >X N" number of fields, producing an N/m number of 

35 combinations of imperceptible codes , each combination having the 
M m" number of imperceptible codes given by a function, an inverse 



6 



of a specific function that gives a specific identification code 
by using the "m" number of imperceptible codes as variables , and 
embedding the N/m number of combinations of imperceptible codes 
into image data divided into the U N" number of fields according 
5 to a specific code embedding technique so that the "m" number 
of imperceptible codes of each combination are embedded into image 
data in the "m" number of fields according to the rule of positional 
correspondence; extracting the imperceptible codes embedded into 
the image data divided into the "N" number of fields according 

10 to a code extraction technique corresponding to the code embedding 
technique; combining the extracted imperceptible codes into the 
N/m number of combinations according to the rule of positional 
correspondence; executing the specific function to conduct a 
specific operation by using the imperceptible codes of each of 

15 the N/m number of combinations as variables; and determining that 
the input digital image data has not been tampered with only when 
results of the specific operation is equal to specific 
identification code for all of the N/m number of combinations. 

Still, furthermore, the present invention provides a 

20 computer-implementedmethodof embedding imperceptible codes into 
digital image data comprising the steps of : dividing, per frame, 
digital image data into an "N" number of fields ( M N" being an 
integer of 2 or more) ; producing an N/m number of combinations 
of imperceptible codes, each combination having an "m" number 

25 of imperceptible codes given by a function , an inverse of a specific 
function that gives a specific identification code by using the 
"m" number of imperceptible codes as variables ( M m" being an integer 
of 2 or more and given by dividing W N" by an integer) ; and embedding 
the N/m number of combinations of imperceptible codes into image 

30 data divided into the "N" number of fields so that the w m" number 
of imperceptible codes of each combination are embedded into image 
data in the "m" number of fields according to a specific rule 
of positional correspondence to give correlation among the xx m" 
number of fields in the "N" number of fields of one frame. 

35 Still, furthermore, the present invention provides a 

computer-implemented method of extracting imperceptible codes 
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from digital image data comprising the steps of: dividing, per 
frame, input digital image data into an "N" number of fields ("N" 
being an integer of 2 or more) according to a specific rule of 
positional correspondence to give correlation among an "m" number 
5 of fields in the M N" number of fields of one frame ("m" being 
an integer of 2 or more and given by dividing "N" by an integer) , 
the input digital image data carrying imperceptible codes that 
have been embedded into the input digital image data by dividing, 
per frame, original digital image data into the X> N" number of 

10 fields, producing an N/m number of combinations of imperceptible 
codes, each combination having the X W number of imperceptible 
codes given by a function, an inverse of a specific function that 
gives a specific identification code by using the "m" number of 
imperceptible codes as variables, and embedding the N/m number 

15 of combinations of imperceptible codes into image data divided 
into the "N" number of fields according to a specific code embedding 
technique so that the "m" number of imperceptible codes of each 
combination are embedded into image data in the V number of 
fields according to the rule of positional correspondence; 

20 extracting the imperceptible codes embedded into the image data 
divided into the "N" number of fields according to a code extraction 
technique corresponding to the code embedding technique / combining 
the extracted imperceptible codes into the N/m number of 
combinations according to the rule of positional correspondence; 

25 executing the specific function to conduct a specific operation 
by using the imperceptible codes of each of the N/m number of 
combinations as variables ; and determining that the input digital 
image data has not been tampered with only when results of the 
specific operation is equal to specific identification code for 

30 all of the N/m number of combinations . 

BRIEF DESCRIPTION OF DRAWINGS 
FIG. 1 shows a block diagram of an embodiment of a recording 
apparatus for embedding imperceptible codes into digital image 
35 data according to the present invention; 

FIG. 2 illustrates division of one-frame digital image data 
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into several fields and imperceptible codes embedded into the 
divided image data in the fields; 

FIG, 3 shows a block diagram of an embodiment of a 
reproduction apparatus for reproducing embedded imperceptible 
5 codes from digital image data, which is compatible with the 
recording apparatus 1 shown in FIG. 1; 

FIG. 4 shows a block diagram of an embodiment of a 
microcomputer circuit programmed for embedding imperceptible 
codes into digital image data; 
10 FIG. 5 shows a flowchart indicating a software program that 

runs on the recording microcomputer circuit shown in FIG. 4; 

FIG. 6 shows a block diagram of an embodiment of a 
microcomputer circuit programmed for reproducing embedded 
imperceptible codes from digital image data, which is compatible 
15 with the recording microcomputer circuit shown in FIG. 4; and 

FIG. 7 shows a flowchart indicating a software program that 
runs on the recording microcomputer circuit shown in FIG. 6. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENT 
2 0 Several embodiments according to the present invention will 

be disclosed with reference to the attached drawings. 
[First embodiment] 

FIG. 1 shows a block diagram of an embodiment of a recording 
apparatus for embedding imperceptible codes into digital image 
25 data. 

A recording apparatus 1 shown in FIG. 1 is equipped with: 
a video memory 11 for storing at least one-frame digital image 
data; a data-field setter 12 for dividing the stored image data 
into 16 pieces of data (each called field image data hereinafter) ; 

30 a code producer 13 for receiving externally input imperceptible 
codes C(l) toC(8) and producing imperceptible codes C (1) toC(16) 
by using the codes C(l) to C(8) and preset identification code 
C (ID) ; and a code embeder 14 for embedding the imperceptible codes 
C(l) to C(16) into the 16 field image data, respectively. 

35 In operation, once external one-frame image data is stored 

in the video memory 11, it is divided by the data-field setter 
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12 into four in a vertical direction and also in a horizontal 
direction, or 16 field image data in total in 16 fields E(l) to 
E(16), as illustrated in FIG. 2. The data-field setter 12 is 
equipped with a frame memory for this operation. 
5 The 16 field image data are read out from the video memory 

11 to the code embeder 14 one by one in accordance with field 
address data (ADD) for the 16 fields used in data division at 
the data-field setter 12 . 

The imperceptible codes C(l) to C(8) are externally input 
10 to the code producer 13 that is equipped withexclusive-OR circuitry . 
The codes C(l) to C(8) are embedded into the field image data 
in the fields E(l) to E(8) , respectively, as disclosed below in 
detail . 

As illustrated in FIG. 2, the fields E(l) to E(8) and the 
15 E (16) toE (9) are correlated with each other as havingpoint symmetry 
at a point 15, the center of the frame image data. 

Once the imperceptible codes C (1) to C (8) are embedded into 
the field image data in the fields E (i) [i = lto8] , the imperceptible 
codesC(16) toC(9) given by the following formulas (1) areembedded 
20 into the field image data in the fields E(17 - i) [i = 1 to 8] . 
C(16) = C(l) xor C(ID), C(15) = C(2) xor C(ID) 
C(14) = C(3) xor C(ID), C(13) = C(4) xor C(ID) 
C(12) = C(5) xor C(ID), C(ll) = C(6) xor C(ID) 
C(10) = C(7) xor C(ID), C(9) = C(8) xor C(ID) ... (1) 
25 According to the formulas (1) , the imperceptible codes 

C(i) [i = 1 to 8] for the field image data in the fields E(i) [i 
= 1 to 8] are logically exclusive-ORed with the identification 
code C (ID) . In each formula (1) , an operator "xor" means a logical 
exclusive-OR operation. The resultant imperceptible codes C(17 
30 - i) [i = 1 to 8] are then embedded into the field image data in 
the fields E(17 - i)[i = 1 to 8]. 

As an example, an ASCII (trademark) -hexadecimal code 
"0x544552414441" corresponding to a 6-character word "TERADA" 
as the code C(l) for the field E (1) is exclusive-ORed with an 
35 ASCI I -hexadecimal code "0x564943544F52" corresponding to a 
6-character word "VICTOR" as the identification code C(ID) . The 
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resultant code C (16) , "0x030C11150BB13" , is embedded in the field 
image data in the field E(16) . 

As disclosed, the code producer 13 employs an exclusive-OR 
function to perform the formulas (1) for exclusive-OR operation, 
5 It is one of the features of the present invention that 

the codes C(17 - i) [i = 1 to 8] to be embedded are given so that 
the identification code C(ID) is given by each exclusive-OR 
operation between one of the codes C(i) [i = 1 to 8] to be embedded 
into the fields E (i) [i = 1 to 8] and the corresponding code C(17 
10 - i) [i = 1 to 8] to be embedded into the fields E(17 - i) [i = 
1 to 8] . 

This feature allows the formulas (1) , the exclusive-OR 
operations between the codes C(i) [i = l to8] and the identification 
code C(ID) , to give the codes C(17 - i) [i = 1 to 8] . 

15 In FIG. 1, the code embeder 14 sends a request signal to 

the video memory 11 to read out the field image data therefrom. 
It further reads out pixel addresses (ADD) on the frame memory 
of the data-field setter 12 to determine whether the read-out 
field image data are those for the fields E(i) [i = 1 to 8] or 

20 the fields E (i) [i = 9 to 16], 

In detail, when the field image data read out to the code 
embeder 14 are those for the fields E(i) [i = 1 to 8] , the code 
producer 13 transfers the codes C(i) [i = lto8] to the code embeder 
14, with no modification. The code embeder 14 then embeds the 

25 codes C(i) [i = 1 to 8] into the field image data in the fields 
E(i) [i = 1 to 8] . 

In contrast, when those field image data are for the fields 
E(i) [i = 9 to 16] , the code embeder 14 embeds the codes C(i) [i 
= 9 to 16] given by the formulas (1) into the field image data 

30 in the fields E(i) [i = 9 to 16] . 

The imperceptible codes may be embedded into the field image 
data according to the known electronic watermarking technologies 
discussed first. Or, the imperceptible codes may be formed with 
a bit train of the least significant bit (LSB) or the LSB-side 

35 2 bits of, for example, intensity data in each macroblock of image 
data in each filed E(i) . 
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The iinperceptible codes C(i)[i = 1 to 16] embedded into 
the field image data by the recording apparatus 1, as disclosed 
above, correspond to the fields E(i) [i = 1 to 16] . In addition, 
each embedded code C(i) [i = 1 to 16] is formed as having a pair 
5 of codes having correlation with each other so that they are point 
symmetrical at the point 15, the center of the frame image data, 
as shown in FIG. 2. Moreover, the codes of each pair have 
correlation with each other so that an exclusive -OR operation 
between them gives the identification code C(ID) . 

10 The correlation for the exclusive-OR operation is given 

according to a rule of inframe positional correspondence used 
at the code embeder 14 . 

The code-embedded image data output from the recording 
apparatus 1 are recorded on storage media and brought into market. 

15 Or, they are distributed over a communications network, such as, 
the Internet. 

FIG. 3 shows a block diagram of an embodiment of a 
reproduction apparatus for reproducing embedded imperceptible 
codes from digital image data, which is compatible with the 

20 recording apparatus 1 shown in FIG. 1. 

A reproduction apparatus 2 shown in FIG. 3 is equipped wi th : 
a video memory 21 for storing at least one-frame digital image 
data; a data-field setter 22 for dividing the stored image data 
into 16 pieces of data (each called field image data hereinafter) ; 

25 a code extractor 23 for extracting imperceptible codes embedded 
in the 16 field image data; a code-pair combiner 24 for combining 
two codes correlated with each other into a code pair among the 
extracted codes , thus creating several code pairs ; an exclusive-OR 
(EX-OR) operator 25 for performing an exclusive-OR operation 

30 between the codes of each pair ; a code determiner 26 for determining 
whether each EX-OR resultant code is equal to the identification 
code C(ID) disclosed with respect to FIG. 1; and a display 27 
for displaying the results given by the code determiner 26. 

In operation, once external one-frame image data is stored 

35 in the video memory 21, it is divided by the data-field setter 
22 into the fields E(l) to E(16) in the same way as explained 
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with respect to FIG. 2. 

The imperceptible codes embedded in the fields E(l) toE(16) 
are exactly the codes C(l) to C(16) when the image data has not 
been tampered with after output from the recording apparatus 1 
5 shown in FIG . 1 . 

In the following disclosure, the embedded codes are 
expressed as Cx(l) to Cx(16) because it is not known at this stage 
whether or not the image data has been tampered with. 

The code extractor 23 sends a request signal to the video 
10 memory 21 to read out therefrom the image data in the fields E (1) 
to E(16) one by one in accordance with field address data (ADD) 
for the fields E (1) to E (16) used in data division at the data-field 
setter 22. 

The code extractor 23 extracts the embedded imperceptible 
15 codes Cx(l) to Cx(16) from the field image data in the fields 
E(l) toE(16) according to an extraction technique that corresponds 
to the embedding technique used at the code embeder 14 (FIG. 1) 
in recording. 

The imperceptible codes Cx(l) to Cx(16) carry 8 pairs of 
20 codes Cx(i) and Cx(17 - i) [i = 1 to 8] correlated with each other. 
In detail, a pair of codes [Cx(l) , Cx(16) ] are correlated with 
each other in the exclusive-OR function. This is the same for 
other code pairs [Cx(2) , Cx(15) ] , [Cx(3) , Cx(14) ] , [Cx(4) , Cx(13) ] , 
tCx(5) , Cx(12) ] , [Cx(6), Cx(ll)], [Cx(7), Cx(10) ] , and [Cx(8) , 
25 Cx(9)]. 

As explained with reference to FIG. 2 , the correlated codes 
of each pair are those for the fields having point symmetry . Thus , 
two correlated codes are combined into one pair according to the 
rule of inframe positional correspondence used at the code embeder 

30 14 (FIG. 1) in recording. 

This code combination is achieved at the code-pair combiner 
24 in accordance with field address data (ADD) for the 16 fields 
used in data division at the data-field setter 22 . The resultant 
each code pair is transferred to the EX-OR operator 25. 

35 The EX-OR operator 25 performs an exclusive-OR operation 

between the codes of each pair Cx(i) and Cx(17 - i) [i = 1 to 
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8] according to the following formulas (2) . 

Cx(l) xor Cx(16) , Cx(2) xor Cx(15) 
Cx(3) xor Cx(14), Cx(4) xor Cx(13) 
Cx(5) xor Cx(12), Cx(6) xor Cx(ll) 
5 Cx(7) xor Cx(10), Cx(8) xor Cx(9) ... (2) 

The EX-OR operator 25 gives the identification code C(ID) 
set at the recording apparatus 1 (FIG. 1) for all code pairs through 
the exclusive-OR operation when the image data provided through 
the recording apparatus 1 has not been tampered with. Then, the 

10 results of exclusive-OR operation at the EX-OR operator 25 are 
transferred to the code determiner 26. 

The code determiner 26 compares the EX-OR resultant codes 
from the EX-OR operator 25 and the preset identification code 
C(ID) . In detail, each EX-OR resultant code and the preset 

15 identification code C(ID) are compared with each other per-bit- 
based exclusive-OR operation. The exclusive-OR operation gives 
"0" when one of bits of each EX-OR resultant code and the 
corresponding bit of the identification code C(ID) are equal to 
each other whereas "1" when these bits are different from each 

20 other. The results of per-bit-based exclusive-OR operations are 
ORed for all bits. An ORed result "0" indicates that all bits 
are equal to each other between each EX-OR resultant code and 
the identification code C(ID) . 

It is thus determined at the code determiner 26 that the 

25 image data provided through the recording apparatus 1 has not 
been tampered with when all EX-OR resultant codes are equal to 
the preset identification code C(ID) whereas determined that the 
image data has been tampered with when at least one EX-OR resultant 
code is not equal to the code C(ID) . 

30 The result of determination at the code determiner 26 is 

transferred to the display 27 and displayed thereon. The display 
27 displays at least as to whether or not the image data has been 
tampered with. In addition, it can display any field of tampered 
frame image data when the image data has been tampered with, thanks 

35 to the code determiner 26 that can determine which EX-OR resultant 
code(s) is (are) not equal to the identification code C(ID). 
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As disclosed in detail , according to the first embodiment 
of recording and reproduction apparatuses, one frame of image 
data is divided into 16 fields in which the imperceptible codes 
disclosed above are embedded. These frame-division and 
5 code-embedding techniques thus offer accurate determination of 
tampering even if a small portion of image data has been tampered 
with. 

Moreover, according to the first embodiment of recording 
and reproduction apparatuses , even if the code-embedding technique 
10 is illegally detected, the detected codes are random codes and 
hence it is almost impossible to find out the rule of codes . 
Therefore , the present invention offers robust protection of image 
contents against tampering. 

In addition, copyright information can be modified as the 
15 identification code C(ID) which can prove copyright of image 
contents . 

[Second embodiment] 

Disclosed in the second embodiment is software that achieves 
several functions of the imperceptible-information recoding and 
20 reproduction apparatuses in the first embodiment. 

FIG. 4 shows a block diagram of an embodiment of a 
microcomputer circuit programmed for embedding imperceptible 
codes into digital image data. 

A recording microcomputer circuit 3 shown in FIG. 4 is 
25 equipped with a CPU 31, a ROM 32, a RAM 33 and an I/O port 34. 

Input to the recording microcomputer circuit 3 via the I/O 
port 34 are digital image data, imperceptible codes C(i)[i = 1 
to 8] and identification code C(ID) . 

Output from the recording microcomputer circuit 3 via the 
30 I/O port 34 are digital image data into which imperceptible codes 
C(i) [i = 1 to 16] are embedded, as disclosed below. 

Storedin theR0M32 are several programmodules for achieving 
the functions of the imperceptible-inf ormation recoding apparatus 
shown in FIG. 1. 

35 The CPU 31 executes embedding of the imperceptible codes 

C(i)[i = l to 16] into digital image data in accordance with the 
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program modules while utilizing the RAM 33 as a video memory and 
a work area. 

A software program that runs on the recording microcomputer 
circuit 3 is disclosed with respect a flowchart shown in FIG. 
5 5. 

In step SI, the identification code C(ID) and the 
imperceptible codes C(i) [i = 1 to 8] are input and prestored in 
the ROM 32. 

One-frame image data is input and saved in the RAM 33 in 

10 step S2. A data-field setting program module prestored in the 
ROM 32 starts in step S3 to divide the saved one-frame image data 
into 16 pieces of data (each called field image data hereinafter) 
in fields E(l) to E(16), as illustrated in FIG. 2. 

An imperceptible-code producing program module prestored 

15 in the ROM32 starts (avariable"i" = l) instepS4. An imperceptible 
code C(l) is set for field image data in the field E(l) in step 
S5. An exclusive-OR operation between the code C(l) and the 
identification code C(ID) is conducted to give an imperceptible 
code C(16) for field image data in the field E (16) in step S6. 

20 A code embedding program module prestored in the ROM 32 

starts in step S7 to embed the codes C(l) and C(16) into the field 
image data in the fields E(l) and E(16), respectively. 

The program written in the code embedding program module 
maybe the known electronic watermarking technique discussed first 

25 or a code— forming technique of forming codes with a bit train 
of the least significant bit (LSB) or the LSB-side 2 bits of, 
for example, intensity data in each macroblock of image data in 
each filed E (i) , as disclosed in the first embodiment. 

Also written in the code embeddi ngprogrammodule is aprogram 

30 for embedding the codes C(i) [i = 1 to 8] into the field image 
data in the fields E(i) [i = 1 to 8] and the codes C(17 - i) [i 
= 1 to 8] , the results of exclusive-OR operation between the codes 
C(i) [i = 1 to 8] and the identification code C(ID) , into the field 
image data in the fields E(17 - i) [i = 1 to 8] . 

35 It is determined in step S8 whether or not the variable 

"i" reaches "8". If not, the value "1" is added to the variable 
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"i" in step S9. 

Since the variable u i" is "1", the value xx l" is added to 
the variable "i" , the process returns to step S5 via step S9 to 
set an imperceptible code C(2) for field image data in the field 
5 E (2) . An exclusive-OR operation between the code C(2) and the 
identification code C(ID) is conducted to give an imperceptible 
code C(15) for field image data in the field E(15) in step S6. 
The codes C(2) and C(15) are then embedded into the field image 
data in the fields E (2) and E (15) , respectively, in step S7 . 

10 It is determined in step S8 whether or not the variable 

"i" reaches "8". Since the variable u i" does not reach "8", the 
process returns to step S5 via step S9 to repeat the 
imperceptible-code producing and code-embedding programs from 
step S5 to step S7: setting imperceptible codes C(3) to C(8); 

15 obtaining imperceptible codes C(14) to C(9) ; and embedding these 
codes into the field image data in the fields E(3) to E(8) and 
E(14) to E(9), respectively. 

Steps S5 to S8 are repeated via step S9 until the variable 
"i" reaches "8" in step S8. 

20 The one-frame image data into which the imperceptible codes 

C(l) to C(16) have been embedded is output from the recording 
microcomputer circuit 3 via the I/O port 34, as shown in FIG. 
4. 

Code-embedded image data output from the recording 
25 microcomputer circuit 3, as disclosed above, are recorded on 
storage media and brought into market. Or, they are distributed 
over a communications network, such as, the Internet. 

FIG. 6 shows a block diagram of an embodiment of a 
microcomputer circuit programmed for reproducing embedded 
30 imperceptible codes from digital image data, which is compatible 
with the recording microcomputer circuit 3 shown in FIG. 4. 

A reproduction microcomputer circuit 4 shown in FIG. 6 is 
equipped with a CPU 41, a ROM 42, a RAM 43, an I/O port 44, a 
display interface (I/F) 46 and a display 45. 
35 The reproduction microcomputer circuit 4 receives , via the 

I/O port 44, digital image data into which imperceptible codes 
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have been embedded through the recording microcomputer circuit 
3 (FIG. 4) and determines, based on the embedded codes, whether 
or the digital image data have been tampered with. 

Storedin theR0M42 are several programmodules for achieving 
5 the functions of the imperceptible-information reproduction 
apparatus shown in FIG. 3. 

The CPU 41 executes reproduction of the imperceptible codes 
embedded into the digital image data in accordance with the program 
modules while utilizing the RAM 43 as a video memory and a work 
10 area. 

A software program that runs on the reproduction 

microcomputer circuit 4 is disclosed with respect a flowchart 

shown in FIG. 7. 

In step S21, one-frame image data is input and saved in 
15 the RAM 43 . A data-field setting program module prestored in the 

ROM 42 starts in step S22 to divide the saved one-frame image 

data into 16 pieces of data (each called field image data 

hereinafter) in fields E(l) to E(16) , in the same way as step 

S3 (FIG. 5) in recording. 
20 A code extraction program module and a code-pair combining 

program module both prestored in the ROM 42 start (a variable 

"i" = 1) in step S23. 

An imperceptible code Cx(l) embedded into field image data 

in a field E(l) is extracted in step S24 . Moreover, an 
25 imperceptible code Cx(16) embedded into field image data in a 

field E(16) is extracted in step S25 . 

The program written in the code extraction program module 

corresponds to the imperceptible-code embedding technique 

installed in the recording microcomputer circuit 3 shown in FIG. 
30 3. In addition, the code-pair combining program module 

corresponds to the code embedding program module installed in 

the recording microcomputer circuit 3. 

In other words , written in the code extraction and code-pair 

combining program modules are the programs for extracting an 
35 imperceptible code Cx (i ) embedded into field image data in a region 

E(i) and then an imperceptible code Cx(17 - i) , correlated to 
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the code Cx(i) , embedded into field image data in a region E (17 
- i) , which are those of a code pair combined according to the 
rule of inframe positional correspondence installed in the 
recording microcomputer circuit 3. 
5 Once imperceptible codes Cx (1) and Cx (16) , a pair of codes , 

are extracted in steps S24 and S25, an exclusive-OR (EX-OR) 
operation program module prestored in the ROM 42 starts to perform 
an exclusive-OR operation between the codes Cx(l) and Cx(16) in 
step S26. The EX-OR resultant code is saved in the RAM 43 in step 
10 S27. 

It is determined in step S28 whether or not the variable 
"i" reaches n 8". If not, the value "1" is added to the variable 
*i" in step S29. 

Since the variable "i" is xx l", the value "1" is added to 

15 the variable "i" , the process returns to steps S24 and S25 via 
step S29 to extract imperceptible codes Cx(2) and Cx(15) embedded 
into field image data in fields E(2) and E(15) , respectively. 

An exclusive-OR operation is performed between the codes 
Cx(2) and Cx(15) in step S26, and the EX-OR resultant code is 

20 saved in the RAM 43 in step S27 . 

It is determined in step S28 whether or not the variable 
xx i" reaches "8" . Since the variable xx i" does not reach "8", the 
process returns to step S24 via step S29 to repeat the code 
extraction and code-pair combining programs from step S24 to step 

25 S27: extracting imperceptible codes Cx(3) to Cx(8) embedded into 
field image data in fields E (3) to E(8) , respectively, and the 
corresponding imperceptible codes Cx(14) to Cx(9) embedded into 
field image data in fields E (14) to E (9) , respectively; performing 
an exclusive-OR operation between each code pair; and saving each 

30 EX-OR resultant code in the RAM 43. Accordingly, eight EX-OR 
resultant codes are saved in the RAM 43. 

In this embodiment, each of the saved EX-OR resultant codes 
is equal to the identification code C(ID) when the codes Cx(l) 
to Cx(16) extracted at the reproduction microcomputer circuit 

35 4 (FIG. 6) are equal to the codes C(l) to C(16) embedded at the 
recording microcomputer circuit 3 (FIG. 4) , or when the image 
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data provided through the circuit 3 has not been tampered with. 

Therefore, in step S30, each of the saved EX-OR resultant 
codes is compared with the identification code C(ID) stored in 
the ROM 42, to give determination that the image data provided 
5 through the recording mi crocompu ter ci rcui 1 3 has not been tampered 
with when all saved codes are equal to the code C(ID) whereas 
it has been tampered with when at least one code is not equal 
to the code C(ID) . 

The result of determination is transferred from the CPU 
10 41 to the display 45 via the I/O port 44 and the display interface 
46 and displayed thereon in step S31 or S32. 

The display 45 displays at least as to whether or not the 
image data has been tampered with. In addition , it can display 
information on field (s) corresponding to a code pair (pairs) for 
15 which the EX-OR resultant code(s) is (are) not equal to the 
identification code C(ID) when it is determined that the image 
data has been tampered with. 

The software or each program module disclosed above can 
be installed in the recording microcomputer circuit 3 or the 
20 reproduction microcomputer circuit 4 from a storage medium or 
downloaded through a network, such as, the Internet. 
[Modifications] 

Although one-frame image data is divided into 16 field image 
data in the first and second embodiments, it can be divided into 

25 a larger number of field image data for more robust 
imperceptible-code recording andpreproduction system with higher 
tamper-determination performance. 

The first and second embodiments employ the exclusive-OR 
function as disclosed above . Choice is , however , not such function 

30 only. The minimum requirement for feasible functions is that a 
function employed in reproduction gives a specific identification 
code with embedded imperceptible codes of each pair as variables 
while another function employed in recording, the reverse of the 
function employed in reproduction, gives those imperceptible 

35 codes . 

In the embodiments disclosed above, for example, a function 
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feasible for reproduction is C(ID) = a * C(i) + b * C(17 - i) , 
where an operator means multiplication, and "a" and "b" are 
a constant, which gives each pair of codes C(i) and C(17 — i) 
[i = 1 to 8] that provides each formula (1) in recording. 
5 Moreover, not only a pair of imperceptible codes employed 

in the embodiments, but also a combination of three or more of 
imperceptible codes can be employed in this invention. 

Fur thermore , the rule of positional correspondence in frame 
image data feasible in this invention is not only based on the 

10 point symmetrical relationship employed in the embodiments but 
also other relationships which give correlation between two codes 
of each pair or among several codes of combination. 

One requirement for each modification disclosed above is 
that it is compatible between imperceptible-code recording and 

1 5 r eproduc t i on . 

As disclosed above in detail , according to the present 
invention, in imperceptible- code recording, digital image data 
is divided, per frame, into an "N" number of fields ( M N" being 
an integer of 2 or more) . An N/m number of combinations of 

20 imperceptible codes are produced. Each combination has an "m" 
number of imperceptible codes given by a function, an inverse 
of a specific function that gives a specific identification code 
by using the "m" number of imperceptible codes as variables ("m" 
being an integer of 2 or more and given by dividing "N" by an 

25 integer) . 

The N/m number of combinations of imperceptible codes are 
embedded into image data divided into the "N" number of fields 
according to a specific code embedding technique so that the "m" 
number of imperceptible codes of each combination are embedded 

30 into image data in the "m" number of fields according to a specific 
rule of positional correspondence to give correlation among the 
"m" number of fields in the "N" number of fields of one frame. 

Moreover, according to the present invention, in 
imperceptible-code reproduction, the code-embedded digital image 

35 data is divided, per frame, into the "N" number of fields. The 
imperceptible codes are extracted from the image data divided 



21 

into the "N" number of fields according to a code extraction 
technique corresponding to the code embedding technique. 

The extracted imperceptible codes are combined into the 
N/m number of combinations according to the rule of positional 
5 correspondence. The specific function is executed to conduct a 
specific operation by using the imperceptible codes of each of 
the N/m number of combinations as variables. 

It is determined that the input digital image data has not 
been tampered with only when results of the specific operation 
10 is equal to specific identification code for all of the N/m number 
of combinations. 

Therefore, according to the present invention , tampered 
digital image data is always accurately detected when it is provided, 
for example, through storage media or over a communications 
1 5 network . 

Moreover, according to the present invention, even if the 
code-embedding technique is illegally detected, the detected codes 
are random codes and hence it is almost impossible to find out 
the rule of codes . Therefore , the present invention offers robust 

20 protection of image contents against tampering. 

Furthermore, according to the present invention, 
determination of tapering is easily made with use of a specific 
identification code. The identification code in this invention 
can be used as copyright information to prove copyright of image 

25 contents. 



